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SEARCH  THEORY 


« 

Search  theory*  came  Into  being  during  World  War  II  with  the  work  of 

♦ 

S.  0.  Koopman  and  his  colleagues  in  the  Antisubmarine  Warfare  Operations 
Research  Group  (ASWORG).  ASWO&C  was  directed  by  P.  M.  Morse  and 
reported  to  Admiral  Ernest  King,  Chief  of  Naval  Operations  and  Commander 
in  Chief,  U.  S.  Fleet.  Inspired  by  Morse,  many  of  the  fundamental 
concepts  of  search  theory  such  as  sweep  width  and  sweep  rate  had  been 
established  by  Spring  of  1942.  Since  that  time,  search  theory  has  grown 
to  be  a  major  discipline  within  the  field  of  Operations  Research.  Its 

applications  range  from  deep-ocean  search  for  submerged  objects  to  deep- 

. 

space  surveillance  for  artificial  satellites. 

The  reader  interested  in  the  origins  of  search  theory  should  con¬ 
sult  Morse  [29]  and  Koopman  [24].  Early  use  of  search  theory  to  develop 
Naval  tactics  is  discussed  in  Morse  and  Kimball  [30];  excerpts  from  this 
work  appear  in  [31]. 

For  a  modern  account  of  search  theory,  the  reader  should  consult 
Stone  [41].  This  book  provides  a  rigorous  development  of  the  theory  and 
includes  an  excellent  bibliography  and  notes  on  previous  research. 
Wasuburn's  monograph  [52]  is  also  recommended. 

e  1.  This  ar' -cle,  in  essentially  the  same  form,  was  originally  prepared 

for  the  Kotz-Johnson  Encyclopedia  of  Statistical  Sciences  copywrited  by 
John  Wiley  and  Sons. 
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^Since  Worid  War  II,  the  principles  of  search  theory  have  been 
applied  successfully  in  numerous  important  operations.  These  include 
the  1966  search  for  a  lost  H-bomb  in  the  Mediterranean  near  Palomares, 
Spain,  ^he^l968  search  for  the  lost  nuclear  submarine  Scorpion  near  the 

l  \t 

Azores and  the  1974  underwater  search  for  unexploded  ordnance 
during  clearance  of  the  Suez  Canal.  The  U.  S.  Coast  Guard  employs 
search  theory  in  its  open  ocean  search  and  rescue  planning  Search 


theory  is  also  used  in  astronomy  >{47  J,  and  in  radar  search  for  satel¬ 
lites  H34 1".  Numerous  additional  applications,  including  those  to 
industry,  medicine,  and  mineral  exploration,  are  discussed  in  the  pro- 

ceedings  t{i5]  of  the  1979  NATO  Advanced  Research  Institute  on  Search 

—  - A 

Theory  and  Applications.  Applications  to  biology y*re ^TvStr^ln  — {T 7}  and 
y/'  [Tol  f  and  an -a-ppl-i-ctrctou  •x-o'*machine  maintenance  ana  inspection  is 
described  in'irlZK'  l1  /  •  >  &  l  ■'/ 1  C  -  , 


Further  references  to  the  literature  are  provided  in  the  first 
th’<  di  i  ^.'r  I  • 

section^  This  is  followed  in  the  second  section  by  an  illustration  of 
how  search  theory  can  be  used  to  solve  an  optimal  search  problem. 
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1.  REVIEW  OF  SEARCH  THEORY  LITERATURE 


Work  In  search  theory  can  be  classified,  at  least  in  part,  accord¬ 
ing  to  the  assumptions  made  about  measures  of  effectiveness,  target 
motion,  and  the  way  in  which  search  effort  is  characterized-  This 
review  is  organized  according  to  these  criteria. 

Measures  of  Effectiveness 


Among  the  many  measures  of  effectiveness  that  are  used  in  search 
analysis,  the  most  common  are: 

probability  of  detection, 

expected  time  to  detection, 

probability  of  correctly  estimating  target  "whereabouts,"  and 

entropy  cf  the  posterior  target  location  probability  distri¬ 
bution. 

Usually  the  objective  of  an  optimal  search  is  to  maximize  probaoll- 
ity  of  detection  with  some  constraint  imposed  on  the  amount  of  search 
effort  available.  For  a  stationary  target,  it  is  shown  in  Stone  [41] 
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that  waen  Che  detection  function  is  concave  or  the  search  space  and 
search  effort  are  continuous,  a  p.>  ^hich  max ’.raizes  probability  of 
detection  in  each  of  successive  increments  of  search  effort  (incre¬ 
mentally  optimal)  will  also  be  optimal  for  the  total  effort  contained  in 
the  increments  (totally  optimal). 

Moreover,  for  stationary  targets,  it  is  often  theoretically 
possible  to  construct  a  "uniformly  optimal"  search  plan.  This  is  a  plan 
for  which  probability  of  detection  is  maximized  at  each  moment  during 
its  period  of  application.  Tf  a  uniformly  optimal  search  plan  exists, 
then  it  will  (1)  maximize  probability  of  detection  over  any  period  of 
application  (i.e.,  be  totally  and  incrementally  optimal)  and  (2)  mini- 
tu  2e  the  expected  time  to  detection.  An  example  of  such,  a  plan 
(originally  due  to  Koopman)  is  given  in  the  last  section. 

In  a  "whereabouts"  search,  the  objective  is  to  correctly  estimate 
the  target's  location  in  a  collection  of  cells  given  a  constraint  on 
search  cost.  The  searcher  mi  succeed  either  by  finding  the  target 
during  search  or  by  correctly  guessing  the  target's  location  after 
search.  These  searches  were  first  studied  systematically  by  Kadane  (see 
[21]).  In  many  cases  of  interest,  Kadane  shows  that  the  optimal  where¬ 
abouts  search  consists  of  an  optimal  detection  search  among  all  cells 
exclusive  of  the  cell  with  the  highest  prior  target  location  probabil¬ 
ity.  If  the  search  fails  to  find  the  target,  then  one  guesses  that  it 
is  in  the  excluded  highest  nrobab<lity  cell. 


) 


» 
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More  recently,  Kadane  and  Stone  [22]  have  considered  whereabouts 
search  in  the  context  of  moving  targets.  They  show  that  the  optimal 
whereabouts  search  plan  may  be  found  by  solving  a  finite  number  of 
optimal  detection  search  problems,  one  for  each  cell  in  the  grid. 

Consideration  of  entropy  as  a  measure  of  effectiveness  is  useful  in 
certain  situations  and  can  be  u9ed  to  draw  a  distinction  between  search 
and  surveillance.  For  certain  stationary  target  detection  search  prob¬ 
lems  with  an  exponential  detection  function.  Barker  [5]  has  shown  that 
the  search  plan  which  maximizes  the  entropy  of  the  posterior  target 
location  probability  distribution  conditioned  upon  search  failure  Is  the 
same  as  the  search  plan  which  maximizes  probability  of  detection. 

In  a  surveillance  search,  the  objectives  are  usually  more  complex 
than  in  a  detection  search.  For  example,  one  may  wish  to  correctly 
estimate  target  location  at  the  end  of  a  period  of  search  in  order  to 
take  some  further  action.  In  this  case,  detection  before  the  end  of  the 
period  can  contribute  to  success  but  does  not  in  itself  constitute 
success.  More  general  problems  of  this  type  are  discussed  by  Tierney 
and  Kadane  [49],  and  they  obtain  necessary  conditions  for  optimality 
when  target  motion  is  Markovian.  In  surveillance  problems  involving 
moving  targets  and  false  contacts  where  the  time  of  terminal  action  may 
not  be  known  in  advance,  Richardson  [38]  suggests  allocating  search 
effort  to  minimize  expected  entropy  (maximize  information). 
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Among  other  measures  of  effectiveness  which  are  used  in  search, 
those  based  upon  minimax  criteria  are  of  particular  interest.  Corwin 
[8]  considers  search  as  a  statistical  game  and  seeks  estimates  for 
target  location.  Alpern  {3],  Gal  [14],  and  Isaacs  [19]  consider  games 
in  which  minimax  strategies  are  sought  for  a  moving  target  seeking  to 
avoid  a  moving  searcher. 


Target  Motion 


Assumptions  about  target  motion  have  a  considerable  influence  on 
the  characteristics  of  search  plans  and  the  difficulty  of  computation. 

TTr%  ►  (  1  Art  ♦-  1  i*  #*11  Wilt-  ehrt  n  ^  mt\1  ant  PA  A  a«*aK1  4  awaI  ..4  f-  a  v*rTA  ► 

4  VUW  k.  iiv  J/i.  V  wa.v‘“0  4.1IS  V-4  V  A  C. 

motion  were  intractable  from  the  point  of  view  of  mathematical  optimiza¬ 
tion.  Pesults  were  usually  obtained  by  considering  transformations 
which  would  convert  the  problem  into  an  equivalent  stationary  target 
problem  Ce.g.,  see  Stone  and  P.ichardson  [42],  Stone  [43],  and  Purslheimo 
[33].  Representative  early  work  on  search  with  Markovian  target  motion 
is  gtveu  in  Pollock  [33],  Dobbie  [12],  and  McCabe.  [28].  Ke liman  [16] 
investigates  the  effect  of  search  upon  targets  whose  motion  is  a  diffu¬ 


sion  process. 


» 


The  first  computationally  practical  solution  to  the  optimal  search 
problem  for  stochastic  target  motion  involving  a  large  number  of  cells 
and  time  periods  is  due  to  Brown  [6].  For  exponential  detection  func¬ 


« 


tions,  he  found  necessary  and  sufficient  conditions  for  discrete  time 
and  space  search  plans,  and  provided  an  iterative  method  for  optimizing 
search  for  targets  whose  motion  is  described  by  mixtures  cf  discrete 
time  and  space  Markov  chains.  Washburn  [51]  extended  Brown's  necessary 
conditions  to  the  case  of  discrete  search  effort.  Washburn  [53]  also 
provides  a  useful  bound  on  how  close  a  plan  is  to  the  optimal  plan. 

Very  general  treatments  of  moving  target  search  are  provided  by 
Stone  [44]  and  by  Stromquist  and  Stone  [46]  allowing  efficient  numerical 
solution  In  a  wide  class  ol  practical  moving  target  problems;  these 
include,  for  example,  non-Markovian  motion  and  non-exponential  detection 
functions. 

The  existence  of  optimal  search  plans  for  moving  targets  is  not  to 
be  taken  for  granted.  L.  K.  Arnold  has  shown  that  there  are  cases  where 
no  allocation  function  satisfies  the  necessary  conditions  given  in 
[46].  In  his  examples,  there  appear  to  be  optimal  plans,  but  they 
concentrate  effort  on  sets  of  measure  zero  and  are  outside  the  class  of 
search  allocation  functions  usually  considered.  He  also  shows  the 
existence  of  optimal  plans  whenever  the  search  density  is  constrained  to 
be  bounded. 
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Search  Effort 


Search  effort  may  he  either  discrete  (looks,  scans,  etc,)  or  con-  ^ 

tinuous  (time,  track  length,  etc.). 

f 

In  problems  involving  discrete  search  effort,  the  target  is  usually 
considered  to  be  located  in  one  of  several  cells  or  boxes.  The  search 
consists  of  specifying  a  sequence  of  looks  in  the  cells.  Each  cell  has 
a  prior  probability  of  containing  the  target.  A  detection  function  b 
is  specified,  where  b(j,k)  is  the  conditional  probability  of  detecting 
the  target  on  or  before  the  kth  look  in  cell  j,  given  that  the 
target  is  located  in  cell  j.  A  cost  function  c  is  also  specified, 
where  c(j,k)  is  the  cost  of  performing  k  looks  in  cell  j.  An  early 
solution  to  this  problem  for  independent  glimpses  and  uni  form  cost  is 
given  by  Chew  [7].  In  this  case, 

Mj,k)  -  b(  j  ,k-l)  -  aj(l-aj)k~1 

for  all  j  and  for  .✓  0;  c(j,k)  »  k  for  all  j  and  k  0*  Addi¬ 
tional  important  results  have  been  obtained  by  Matula  [27],  Blackwell 
(see  Matula  [27]),  Kadane  [20],  and  Wegener  [54],  [55],  and  [56]. 

« 


t 


Kadane's  result  [20]  is  particularly  interesting  since  he  uses  a 
variant  of  the  Neyraan-Pearson  lemma  to  obtain  an  optimal  plan  for  the 
general  case  where  b(j,k)  -  b(j,k-i)  is  a  decreasing  function  of  k 
for  all  j. 

In  problems  involving  continuous  effort,  the  target  may  be  located 
in  Euclidean  n-space  or  in  cells  as  in  the  case  of  discrete  search.  In 
the  former  case  it  is  assumed  that  the  search  effort  is  "infinitely 
divisible"  in  the  sense  that  it  may  be  allocated  as  finely  as  necessary 
over  the  entire  search  space.  The  search  problem  was  originally 
expressed  In  this  form  by  Koopman  (see  [23]).  The  continuous  effort 
case  will  be  considered  in  greater  detail  in  the  remainder  of  this 
article. 

Just  as  with  discrete  search  effort,  there  is  a  detection  func¬ 
tion  b,  where  b(x, z)  is  the  probability  of  detecting  the  target 
with  z  amount  of  effort,  applied  to  the  point  :  ,  given  the  target  is 
located  at  x.  If  r  ia  a  cell  index,  then  z  represents  the  amount 
of  time  or  track  length  allocated  to  the  cell.  If  x  is  a  point  in 
Euclidean  n-space,  then  z  is  a  density  as  will  be  made  clear  in  the 
next  section. 

Koopman' o  original  solution  [23]  to  the  search  pr made  use  of 
an  exponential  function  for  b  of  the  form 


b(x,z)  *  1  -  exp  (-<z) 


where  x  is  a  positive  constant  which  may  depend  upon  x,  DeGuenin 
[10]  considered  a  more  general  class  of  detection  functions  now  referred 

♦ 

to  as  "regular”  (see  [41]).  Dobbie  [11]  considered  sequential  search 
with  a  concave  detection  function.  Richardson  and  Belkin  [37]  have 
treated  a  special  type  of  regular  detection  function  obtained  when  the 
parameter  x  in  the  exponential  effectiveness  function  is  a  random 
variable.  Such  functions  occur  when  sensor  capabilities  are  uncer¬ 
tain.  Tatsuno  and  Kisi  [48]  address  similar  problems.  Stone  has  con¬ 
sidered  very  general  detection  functions  and  has  collected  the  results 
in  [41]. 

For  differentiable  detection  functions,  Wagner  [50]  obtained  suffi¬ 
cient  conditions  for  an  optimal  search  plan  with  continuous  effort  using 
a  non-linear  functional  version  of  the  Neyman-Pearson  lemma. 

Remarks 

Search  theory  remains  a  field  of  active  research  in  spite  of  the 
considerable  advances  made  since  its  inception  more  than  forty  years 
ago.  A  review  of  the  current  status  of  search  theory  in  terras  of  prac- 
tical  applications  is  given  in  [45].  Many  problems  remain  to  be  solved, 
particularly  in  cases  involving  multiple  targets  and  false  targets. 

Also  systematic  methods  are  needed  for  constructing  tht  prior  target 
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location  probability  distribution  from  soraeciraes  conflicting  subjective 
opinion.  More  work  is  also  needed  on  problems  where  it  is  essential  to 
take  exact  account  of  search  track  continuity  or  the  switching  cost  of 
moving  from  one  region  to  another.  These  problems  remain  intractable 
although  some  recent  progress  has  been  made  (see,  e.g.,  [54]  and  [25]). 

Brown's  innovative  solution  to  an  important  class  of  moving  target 
search  problems  has  removed  an  impediment  to  progress  in  this  area.  An 
interesting  extension  of  Brown's  results  occurs  In  the  context  of  search 
and  rescue  operations  carried  out  at  sea.  Here  the  target's  state  may 
be  unknown.  That  is,  the  target  may  be  the  survivor  of  a  mishap  and  may 
be  aboard  the  distress  vessel,  afloat  in  a  life  raft,  or  alone  in  the 
water  supported  only  by  a  life  jacket.  The  detectability  of  the  target 
varies  with  these  alternatives  as  does  the  drift  motion  and  the  expected 
time  of  survival  of  the  target.  A  solution  to  this  important  problem  is 
given  in  [9]  under  very  general  assumptions. 

Unfortunately,  Brown's  approach  applies  only  to  the  case  where 
search  effort  is  continuous.  Efficient  algorithms  are  still  required  in 
the  case  where  search  effort  is  discrete. 
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2.  SOLUTION  TO  AN  OPTIMAL  SEARCH  PROBLEM 

This  section  shows  how  optimal  search  theory  can  be  applied  to  an 
important  class  of  search  problems  where  the  prior  (i.e.,  before  search)  4 

probability  distribution  for  target  location  is  normal  and  the  detection 
function  b  (see  section  1)  is  exponential.  Many  search  problems  which, 
occur  in  practice  are  of  this  form. 

Definitions 


Let  X  denote  the  plane,  and  let  A  be  some  arbitrary  region  of 
interest.  Then  the  prior  probability  that  the  target's  location  x  is 
in  A  is  given  by 

Pr  [x  £  A]  »  /  p(x)dx  , 

I 


i 

i 


where 


!  p(x)  -  — —  exp  (-|xj  2/2.o2) 

i  2*0  ^ 

! 

i 


(i) 


4 
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is  the  circular  normal  density  function,  with  mean  at  the  origin  and 
variance  o  in  both  oordinate  directions.  The  distance  of  x  from 
the  origin  is  denoted  by  |x|. 

Let  F  be  the  class  of  non-negative  functions  defined  on  X  with 
finite  integral.  By  definition,  this  i3  the  class  of  search  allocation 
functions,  and  for  feF 

/A  f(x)  dx 

is  the  amount  of  search  effort  placed  in  region  A. 

We  will  assume  that  the  unit  cf  search  effort  is  ’’time"  and  thus 
the  "cost”  C  associated  with  the  search  is  the  total  amount  of  time 
consumed.  In  this  case  c(x, z)  ■  z,  and  the  cost  functional  C  is 
defined  by 


* 


C[f]  -  /x  c(x,  f(r)]  dx  *  /x  f(x)  dx 


The  measure  of  effectiveness  will  be  probability  of  detection. 
Hence,  the  "effectiveness  functional"  D  is  assumed  to  have  the  form 


D[f]  -  /x  b(x,  f(x>)  p(x)  dx  , 

where  b  is  the  detection  function.  As  mentioned  earlier,  the  detec¬ 
tion  function  is  assumed  to  be  exponential,  and  hence,  for  R  >  0 


(2)  • 


b(x,  z)  “  1  -  exp  (-Rz) 


(3) 


The  coefficient  R  is  called  the  "sweep  rate"  and  measures  the  rate  at 
which  search  is  carried  out  (see,  e.g. ,  [24]). 

In  order  to  understand  (2),  suppose  for  the  moment  that  search 
allocation  function  f  is  constant  over  A,  zero  outside  of  A,  and 
corresponds  to  a  finite  amount  of  search  time  T.  Then  for  xeA 


f(x)  »  T/area  (A)  , 


i 
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since  by  definition 


T  *  /x  f ( x)  dx  *  f(*o)  /a  dx  “  f (*o)  area  (A) 
for  any  Xq£A. 

The  detection  functional  can  then  be  written 


D[f]  -  /x  b(x,  f(x))  p(x)  dx 


*  JA  {l  -  exp(-RT/area  (A))}  p(x)  dx 


»  {l  -  exp  (-RT/area  (A))}  p(x)  dx 


*  {l  -  exp  (-RT/area  (A))}  Pr[xeA] 


This  is  the  so-called  "random-search  formula." 


Sufficient  Conditions  for  Optimal  Search  Plans 


Using  Lagrange  multipliers  in  the  fashion  introduced  by  Everett 
l 13],  one  can  find  sufficient  conditions  for  optimal  search  plans  for 
stationary  targets  that  provide  efficient  methods  for  computing  these 
plans.  Define  the  pointwise  Lagrangian  l  as  follows: 


f(x,  z,  X)  -  p(x)b(x,  z)  -Xc  (x,  s)  for  all  xeX, 


z  >  0  and  X  >  0 


(4) 


If  we  have  an  allocation  f*^  which  maximizes  the  pointwise  Lagrangian 
for  some  value  of  X  0,  i.e,, 


A(x,  f*^(x)  ,X)  _>  Z(x,  z,X)  for  all  xeX  and  z  >  0  , 


(5) 


then  we  can  show  that  D[f*^]  is  optimal  for  its  cost  C[f*^],  i.e., 


D[f*xl  _>  D[f]  for  any  feF  such  that  C[f]  _<  C[ f ] 


(6) 


I 


-16- 


Equation  (6)  says  that  plan  f*^  maximizes  the  detection  probability 
over  all  plans  using  effort  C[f*^]  or  less. 

To  show  that  (6)  is  true,  we  suppose  f e  F  and  C[  f  ]  _<_  0[f*^]. 
Since  f(x)  2  0,  (5)  yields 


p(x)b(x, f*^(x) )-Ac(x, f*^(x) )  2.  P(y)h(x, f (x) )-Xc(x, f (x) )  for  xeX  .  (7) 


Integrating  both  sides  of  (7)  over  X,  we  obtain 


D[f*x]  -  AC(f*g]  2  D[ f ]  -  AC[f] 

which,  along  with  A  20  and  C[f]  jC.  C[f*^].,  implies 

D[f*A]  -  D[f]  2  X  <C[f*A]  -  C[f])  2_  0  • 

This  proves  (6)  and  hence  that  Is  an  optimal  search  plan  for  its 

cost  C[f*^]. 


-17- 


The  way  to  calculate  optimal  search  plans  is  to  choose  a  X  >  0 
and  find  f*^  to  maximize  the  pointwise  Lagrangian  for  this  X.  For 
each  x£X,  finding  f^(x)  is  a  one-dimensional  optimization  problem. 
If  the  detection  function  is  well-behaved  (e.g.,  exponential),  then  one 
can  solve  for  f*^  analytically.  Since  C[f*^]  is  usually  a  decreas¬ 
ing  function  of  X,  one  can  use  a  computer  to  perform  a  binary  search 
to  find  the  value  of  X  which  yields  cost  C[f*^)  equal  to  the  amount 
of  search  effort  available.  The  resulting  f*^  is  the  optimal  search 
plan. 


Example 


I  In  the  case  of  bivariate  normal  target  distribution  (1)  and  exoo- 

!  “  ’  ' 

nential  detection  function  (3),  we  can  compute  C[f*^]  and  the 
£  optimal  plan  explicitly  (see  [23]).  The  result  is  that  for  T  amount. 

of  search  time,  the  optimal  allocation  function  f*  (dropping  the 
subscript  X  which  depends  on  T)  is  given  by 


t 


f*(  »  ) 


2 

2o  R 


0,  otherwise, 


v 


for 


r 

o 


where  all  search  is  confined  to  a  disk  of  radius  rQ  defined  by 


4 


i 
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20  /RT/V 


The  probability  of  detection  corresponding  to  f*  is 


D(f*]  -  1  -  (l  +  )  exp  (-r  2/  2a2) 

2aZ  ° 


and  the  expected  time  to  detection  t  is 


t  -  6  ir  o2/k  . 


Thus,  for  a  given  amount  of  search  effort  T,  the  optimal  search 
plan  concentrates  search  in  the  disk  of  radius  rQ  which  then  expands 
as  more  effort  becomes  available.  It  can  be  shown  that  the  optimal 
search  plan  can  be  approximated  by  a  succession  of  expanding  and  over¬ 
lapping  coverages.  The  fact  that  search  is  repeated  in  the  high  proba¬ 
bility  areas  is  typical  of  optimal  search  in  a  great  many  situations. 

I 
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Note  that  probability  of  detection  depends  upon  the  ratio  r0/o 
and  increases  to  one  as  search  t  fort  increases  without  bound.  The 
expected  time  to  detection  is  finite  and  varies  directly  with  o  and 
inversely  with  the  sweep  rate  R. 
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